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Abstract 


This  report  describes  a  number  of  results  which  have  been  obtained  in 
the  Data  Adaptive  Detection  and  Estimation  project.  The  various  papers 
summarized  deal  with  properties  of  autoregressive  representations  as  they 
relate  to  detection  and  estimation  in  partially  known  signal  and/or  noise 
environments.  Complete  copies  of  the  wotks  can  be  obtained  from  the  author. 
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SUMMARY 


1 )  "On  the  Statistics  of  the  Estimated  Reflection  Coefficients  of  an 
Autoregressive  Process"  (with  John  Makhoul  of  Bolt,  Beranek,  and  Newman) — 
submitted  to  IEEE  Trans,  on  Acoustics,  Speech,  and  Signal  Processing. 

This  paper  derives  a  recursive  means  of  computing  the  Cramer-Rao  (CR) 
lower  bound  for  the  estimated  reflection  coefficients  of  an  autoregressive 
(AR)  process.  The  exact  algorithm  which  computes  the  bound  is  given  in 
Figure  1.  Since  the  CR  bound  is  attained  asymptotically  (for  large  data 
records)  for  a  Maximum  Likelihood  Estimate  of  the  reflection  coefficients, 
one  can  also  use  the  algorithm  of  Figure  ]  to  describe  the  statistics  of 
the  MLE.  It  is  also  shown  in  this  paper  that  all  currently  available 
estimators  for  the  reflection  coefficients  are  MLE's  for  large  data  recc.ds. 
Thus,  the  results  can  be  used  to  statistically  characterize  these  estima¬ 
tors,  i.e.,  the  Burg  algorithm*  as  an  example.  An  example  of  the  actual 
covariance  matrix  (obtained  via  computer  simulation)  and  the  CR  bound  is 
shown  in  Figure  2.  The  data  length  was  1000  points. 

2)  "Simple  Proofs  of  the  Minimum  Phase  Property  of  the  Prediction  Error 
Filter"  (with  Louis  Pakula  of  U.R.l.) — IEEE  Trans,  on  Acoustics,  Speech,  and 
Signal  Processing,  April  1983. 

Presented  are  two  simple  proofs  which  assert  the  well  known  property 
that  all  the  zeros  of  the  optimal  prediction  error  filter  lie  on  or  within 
the  unit  circle  of  the  Z  plane.  The  first  proof  is  somewhat  incomplete  in 
that  it  only  shows  that  the  zeros  lie  on  or  within  the  unit  circle.  It 
gives  no  indication  as  to  when  the  zeros  must  be  totally  within  the  unit 
circle.  However,  it  is  extremely  simple.  The  second  proof  which  is  slightly 
■ore  complex  also  determines  conditions  under  which  the  zeros  may  be  on  the 
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3) 


ii'U  circle. 

"Recursive  Maximum  Likelihood  Estimation  of  Autoregressive  Processes" — 
IEEE  Trans,  on  Acoustics,  Speech,  and  Signal  Processing,  February  1982. 

An  estimation  algorithm  is  derived  which  is  a  closer  approximation  to 
the  true  MLE  of  the  parameters  of  an  AR  process  than  currently  existing 
procedures.  Specifically,  the  algorithm  does  not  make  the  standard  assump¬ 
tion  that  the  determinant  of  the  filter  covariance  matrix  can  be  neglected 
in  the  maximization  of  the  likelihood  function.  This  common  assumption  is 
not  valid  for  short  data  records  and/or  highly  peaked  spectra.  By  incorpo¬ 
rating  the  determinant  and  maximizing  the  likelihood  function  recursively 
(in  model  order)  more  accurate  parameter  and  spectral  estimates  are  obtained. 
The  algorithm  is  summarized  in  Figure  3.  Also,  Figure  4  summarizes  some 
simulation  results  which  verify  the  improved  performance  of  the  algorithm 
for  short  data  records.  (RMLE  »  Recursive  MLE,  FB  *  Forward-Backward, 

YW  -  Yule-Walker). 

4 )  "More  Accurate  Autoregressive  Parameter  and  Spectral  Estimates  for 
Short  Data  Records" — IEEE  Workshop  on  Spectral  Estimation,  Hamilton,  Ontario, 
August  1981. 

This  paper  is  a  shortened  version  of  3. 

5)  "Some  Results  in  Linear  Interpolation  Theory" — to  be  published  in  IEEE 
Trans,  on  Acoustics,  Speech,  and  Signal  Processing. 

The  optimal  finite  length  interpolation  filter  for  a  wide  sense  stationary 
process  is  derived.  It  is  shown  that  for  an  AR  process  one  can  significantly 
reduce  the  power  out  of  an  FIR  filter  by  performing  interpolation  rather  than 
the  more  common  one  sided  prediction.  Also,  the  optimal  interpolation  filter 
for  an  AR  process,  i.e.,  the  one  which  minimizes  the  interpolation  error 
power,  is  found  to  be  the  one  which  attempts  to  interpolate  at  the  midpoint 
of  a  data  record.  This  result  although  intuitive  is  shown  not  to  hold  for 


2 


more  general  processes.  Finally,  some  well  known  results  in  infinite 
length  FIR  filter  interpolation  are  simply  derived  using  AR  approximations 
of  infinite  order. 

6)  "Accurate  Frequency  Estimation  at  Low  Signal-to-Noise  Ratios" — sub¬ 
mitted  to  IEEE  Trans,  on  Acoustics,  Speech,  and  Signal  Processing. 

An  iterative  algorithm  for  frequency  estimation  of  sinusoids  in  white 

noise  is  described  and  analyzed.  The  algorithm  iteratively  computes  AR 

parameter  estimates  after  the  original  data  has  been  filtered  by  an  all 

pole  filter.  The  algorithm  is  shown  to  be  related  to  the  Steiglitz-McBride 
2 

algorithm  .  It  is  summarized  in  Figure  5,  where  it  has  been  termed  the 

Iterative  Filtering  Algorithm  (IFA).  For  two  sinusoids  closely  spaced  in 

frequency  the  algorithm  performance  is  shown  in  Figure  6.  Also,  shown  is 

the  CR  bound  (for  unbiased  estimators)  and  the  principal  component  (PC) 

3 

approach  of  Tufts  and  Kumaresan  .  The  IFA  outperforms  the  PC  approach 
at  low  SNR's.  The  PC  approach  had  been  claimed  to  offer  the  best  per¬ 
formance  other  than  a  direct  MLE,  at  low  SNR's.  At  higher  SNR's  a  bias 
is  present  which  tends  to  degrade  the  performance  of  the  IFA.  In  Figure  7 
a  comparison  is  made  with  a  direct  MLE,  which  amounts  to  a  nonlinear 
least  squares  estimator.  Again  at  low  SNR  the  IFA  appears  to  perform 
better . 

7)  "Asymptotically  Optimal  Detection  in  Unknown  Colored  Noise  via 
Autoregressive  Modeling" — to  be  published  in  IEEE  Trans,  on  Acoustics, 
Speech,  and  Signal  Processing. 

The  problem  of  detecting  a  known  signal  in  Gaussian  noise  of  unknown 
covariance  is  addressed.  The  noise  is  assumed  to  be  an  AR  process  of  known 
order  but  unknown  coefficients.  Thus,  the  parameterization  of  the  covari¬ 
ance  leads  to  a  problem  in  composite  hypothesis  testing.  Since  in  general 
no  uniformly  most  powerful  test  exists,  the  Generalized  Likelihood  Ratio 
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Test  (GLRT)  is  applied.  The  GLRT  detector  which  results  is  shown  in  Figure 
8.  As  expected  adaptive  prewhiteners  are  included  which  assume  either  the 
signal  is  present  (upper  channel)  or  absent  (lower  channel).  The  detector 
is  not  a  single  estimated  prewhitener  and  matched  filter  as  might  be  ex¬ 
pected.  The  performance  of  the  detector  is  shown  in  Figures  9  and  10  for 
an  AR  process  of  order  p»l  and  parameter  a=-0.9  and  for  various  data  record 
lengths  N>20,100.  The  optimal  curve  is  the  performance  assuming  a  known 
covariance  function,  i.e.,  a  prewhitener  and  matched  filter.  It  is  seen 
that  even  for  short  data  records  the  performance  is  nearly  optimal.  Finally, 
it  is  proven  that  for  large  data  records  the  GLRT  performance  is  equal  to  that 
of  a  prewhitener  (assuming  a  known  covariance)  and  matched  filter  and  hence 
is  optimal. 

)  "Detection  for  Active  Sonars  via  Autoregressive  Modeling," — Workshop 

on  Maximum  Entropy  and  Bayesian  Methods  in  Applied  Statistics,  University 
of  Wyoming,  Laramie,  Wyoming,  August  1982. 

This  paper  is  a  shortened  version  of  7. 


TABLE  2 


TRUE  VALUES 

ESTIMATED  VALUES 

K,  K2K3 

0.570 

0.570 

0.570 

mm 

0.568 

0.564 

0.541 

-  0.490 

0.000 

0.523 

-  0.479 

-  0.006 

nCk 

-  0.490 

0.675 

0.000 

—  0.479 

0.689 

0.028 

0.000 

0.000 

0.675 

_ 

-  0.006 

0.028 

0.665 

TRUE  VALUES 

ESTIMATED  VALUES 

Kt  K2K3 

0.570 

-0.570 

0.570 

0.557 

-  0.563 

0.563 

7.210 

-1.790 

0.000 

6.988 

-  1.858 

-0.151 

nck 

-1.790 

0.675 

0.000 

-1.858 

0.716 

0.016 

0.000 

0.000 

0.675 

-0.151 

0.016 

0.692 

Figure  2.  True  and  estimated  values  of  the  reflection 

coefficients  and  their  covariances  for  two  AR(3) 
processes.  The  two  processes  differ  by  the  sign 
of  K  . 
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Figure  3.  Summary  of  Recursive  MLE  Algorithm. 
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TABl.E  I 

Comparison  or  AR  Paramftir  Esvmation  Mitw>i>n 


/V  -  1 1 

Data  Points 

0  . 

"2 

True  AR  Parameters 

-2.76070 

3.81060 

-2.65350 

0  92380 

Mean- YW 

Mean- I'D 

Mean-  RMLE 

-1.01527 

-2.59333 

2.62975 

0  61949 
3.42185 
3  51086 

0.04  4  66 
2.27303 
-2.37156 

0 05735 
0.77262 
0.81412 

Variance  YW 
Variance  -  I  B 

Variance  RMLIC 

3.13780 
0.1 1598 
0.10960 

10.29627 
0  52574 
0  3337! 

7.33884 

049307 

0.26227 

0.75840 
0  08462 
0  04148 

V  -  50 

Data  Poinls 

o  1 

u2 

True  AR  Parameters 

2.76070 

3.81060 

2.65  350 

(I.Q?  i.Mi 

Mean  YW 

Mean  -  I  B 

Mean  -RMLE 

1.30552 

2.72368 

2.71515 

0.92378 

3.71024 

3.69876 

0.05153 
-2.54984 
-2.54  345 

(l.(>6719 

0.8T(C9 

0.8*765 

Variance- YW 
Variancc-I  B 

Variance  RMI.I 

2.22544 
0. 0075  8 
0.01076 

8.56804 

0.04138 

0.0448: 

6.90835 

0.04219 

C. 04 069 

0.74526 
0.OOS58 
0.0074  1 

Figure  4.  Comparison  of  AR  Parameter  Estimation 
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Figure  7.  Comparison  of  Frequency  Estimators, 
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